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DETAILED ACTION 

4 

Double Patenting 

1 . The nonstatutory double patenting rejection is based on a judicially created doctrine 
grounded in public policy (a policy reflected in the statute) so as to prevent the unjustified or 
improper timewise extension of the "right to exclude" granted by a patent and to prevent possible 
harassment by multiple assignees. A nonstatutory obviousness-type double patenting rejection 
is appropriate where the conflicting claims are not identical, but at least one examined 
application claim is not patentably distinct from the reference claim(s) because the examined 
application claim is either anticipated by, or would have been obvious over, the reference 
claim(s). See, e.g., In re Berg, 140 F.3d 1428, 46 USPQ2d 1226 (Fed. Cir. 1998); In re 
Goodman, 1 1 F.3d 1046, 29 USPQ2d 2010 (Fed. Cir. 1993); In re LongU 759 F.2d 887, 225 
USPQ 645 (Fed. Cir. 1985); In re Van Ornum, 686 F.2d 937, 214 USPQ 761 (CCPA 1982); In re 
Vogel 422 F.2d 438, 164 USPQ 619 (CCPA 1970); and In re Thorington, 418 F.2d 528, 163 
USPQ 644 (CCPA 1969). 

A timely filed terminal disclaimer in compliance with 37 CFR 1.321(c) or 1.321(d) may 
be used to overcome an actual or provisional rejection based on a nonstatutory double patenting 
ground provided the conflicting application or patent either is shown to be commonly owned 
with this application, or claims an invention made as a result of activities undertaken within the 
scope of a joint research agreement. 

Effective January 1, 1994, a registered attorney or agent of record may sign a terminal 
disclaimer. A terminal disclaimer signed by the assignee must fully comply with 37 CFR 
3.73(b). 
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2. Claims 1-3 and 10-12 are rejected on the ground of nonstatutory obviousness-type double 
patenting as being unpatentable over claims 1-3 and 5-7 of U.S. Patent No. 6,987,882 by Curry 
et al. ( M Curry '882") in view of U.S. Patent 6,301,386 by Zhu et al. ("Zhu"). 

Claim 1 of Curry '882 recites all of the limitations as that of claim 1 of the present 
application, except claim 1 of the present application recites the additional limitation of "(a) sub- 
sampling the image signal by a programmable amount" and then receiving the sub-sampled 
image for outputting a foreground and a background signal. 

Zhu discloses a method (figure 1 ) for identifying text apart from background in an image 
in order to process the text for recognition purposes and the like. In particular, Zhu teaches that, 
prior to segmenting the foreground text from the background (108), it is advantageous to sub- 
sample the image (103). The sub-sampling step is preferred because, according to Zhu, the 
reduction in resolution has the effect of reducing processing demands. However, the sub-sampled 
image will still exhibit sufficient detail to permit effective text/background segmentation. See 
column 3/3-8. In view of this teaching that an input image to be subjected to 
foreground/background separation can be sub-sampled in order to reduce the computational 
intensiveness, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify claim 1 of Curry '882 by Zhu to achieve claim 1 of the present invention by 

w 

sub-sampling the inputted document image. 

Dependent claims 2 and 3 of the present invention recite the same additional features as 
dependent claims 2 and 3, respectively, of Curry '882, and therefore, they are also obvious 
variants of the corresponding claims of Curry '882. 
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Claim 5 of Curry '882 recites all of the limitations as that of claim 10 of the present 
application, except claim 10 of the present application recites the additional limitation of "(a) 
sub-sampling the image signal by a programmable amount" and then receiving the sub-sampled 
image for outputting a foreground and a background signal, and is written in mieans-plus- 
function language. 

Zhu discloses a method (figure 1) for identifying text apart from background in an image 
in order to process the text for recognition purposes and the like. In particular, Zhu teaches that, 
prior to segmenting the foreground text from the background (108), it is advantageous to sub- 
sample the image (103). The sub-sampling step is preferred because, according to Zhu, the 
reduction in resolution has the effect of reducing processing demands. However, the sub-sampled 
image will still exhibit sufficient detail to permit effective text/background segmentation. See 
column 3/3-8. In view of this teaching that an input image to be subjected to 
foreground/background separation can be sub-sampled in order to reduce the computational 
intensiveness, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify claim 5 of Curry '882 by Zhu to achieve claim 10 of the present invention by 
sub-sampling the inputted document image. 

Dependent claims 1 1 and 12 of the present invention recite the same additional features 
as dependent claims 6 and 7, respectively, of Curry '882, and therefore, they are also obvious 
variants of the corresponding claims of Curry '882. 
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3. Claims 4-9 are rejected on the ground of nonstatutory obviousness-type double patenting 
as being unpatentable over claims 5-7 and 9-1 1 of U.S. Patent No. 6,987,882 by Curry et al. 
("Curry '882"). 

Claims 5-7 and 9-1 1 of Curry '882 recite all of the limitations of, and therefore anticipate, 
claims 4-9, respectively, of the present application. Anticipation is tantamount to obviousness. 

» 

Claim Objections 

4. Claims 10-12 are objected to because of the following informalities: 

Claim 10 recites: "A system for separating an image signal, ... the method comprising the 
operations of: " 

Claim 11 recites: "The method of claim 10 ... " 
Appropriate correction of these typos is required. 

Claim Rejections - 35 USC §103 

5. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

6. Claims 4-9 are rejected under 35 U.S.C. 103(a) as being unpatentable over U.S. Patent 
6,731,800 by Barthel et al. ("Barthel"). 
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Regarding claims 4 and 7, Barthel discloses a computer-implemented method (figure 1) 
for separating an image signal into a set of image planes in accordance with a control signal, the 
method comprising the operations of: 

(a) receiving the control signal and producing a selector signal, via a selector module (i.e. 
the "Text Detection (Segmenting)" block receives binary/quantized image data as a "control 
signal" from the "Quantizing/Binarizing" block; the received signal is then used to produce a 
"selector" signal that indicates which image regions are selected for subsequent edge 
processing — see figure 3 where all connected regions in the binary quantized image data are 
determined, and then size filtration of the regions is performed in order to identify those regions 
lying within a certain size range); 

(b) receiving the selector signal and producing a decision signal, via an edge processing 
module (the "selector" signal is received by a "Nonlinear Edge Detection" step, which performs 
edge detection on the selected regions; after further processing, a binary mask, or "decision 
signal," which indicates whether each region corresponds to text or background, is generated); 
and 

(c) receiving the image signal and the decision signal (i.e. the large block in figure 1 
receives both), and outputting a foreground signal and a background signal, via a 
foreground^ackground separation module, a representation of the current pixel of the image 
signal being included in at least one of the foreground signal and the background signal in 
accordance with the decision signal (i.e. a pixel is indicated as being included in either the 
background image or the foreground image based on the binary mask ("decision signal") 
outputted from the "Text Detection (Segmenting)" block). 
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Since Barthel's disclosure is written in terms of a computer-implemented method, it does 
not expressly disclose the system comprising means or article of manufacture comprising 
program codes for performing the above steps, per se. However, at the time the invention was 
made, those skilled in the art would have readily understood that Barthers method was intended 
to be performed via a computer, thereby necessitating the employment of physical components to 
perform the method, e.g. processors or the like performing programmed methods/modules. That 
is to say that the claimed system and article of manufacture having program codes for separating 
an image signal are rendered obvious in view of Barthel's corresponding method for the same — 
Official Notice taken. 

Regarding claims 5 and 8, Barthel discloses operation (c) further comprises: 
receiving the foreground signal (figure 4) and the background signal (figure 5); 
filling undefined pixels in the foreground and background signals with values computed 
so as to substantially prevent artifacts and to facilitate good compression ratio, using a cleanup 
module (figures 4 and 5: "Filling the remaining regions"; see also column 5, lines 10-15 and 43- 
47); and 

outputting a final foreground signal and a final background signal (see figure 1). 
Regarding claim 6 and 9, Barthel discloses the operation of filling comprises: 
extending content of defined pixels in each of the foreground and background signals to 
neighboring undefined pixels by filling neighboring undefined pixels with diluted foreground 
and background values, respectively, using a dilate module (figures 4 and 5: "spreading"); 
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averaging non-zero content of the diluted foreground and background values over 
minimum coded unit blocks and outputting averaged block values, using a block average module 
(column 5, lines 10-15 and 43-47: the average value of all values not equal to zero is calculated 
and used for filling); and 

filling any remaining undefined pixels with the averaged block values, using a fill module 
(figures 4 and 5: "Filling the remaining regions"). 

7. Claims 1-3 and 10-12 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
U.S. Patent 6,731,800 by Barthel et al. ("Barthel") in view of U.S. Patent 6,301,386 by Zhu et al. 
("Zhu"). 

Regarding claims 1 and 10, Barthel discloses a computer-implemented method (figure 1) 
for separating an image signal into a set of image planes in accordance with a control signal, the 
method comprising the operations of: 

(a) receiving the control signal and producing a selector signal, via a selector module (i.e. 

» 

the "Text Detection (Segmenting)" block receives binary/quantized image data as a "control 
signal" from the "Quantizing/Binarizing" block; the received signal is then used to produce a 

* 

"selector" signal that indicates which image regions are selected for subsequent edge 
processing — see figure 3 where all connected regions in the binary quantized image data are 
determined, and then size filtration of the regions is performed in order to identify those regions 
lying within a certain size range); 
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(b) receiving the selector signal and producing a decision signal, via an edge processing 
module (the "selector" signal is received by a "Nonlinear Edge Detection" step, which performs 
edge detection on the selected regions; after further processing, a binary mask, or "decision 
signal," which indicates whether each region corresponds to text or background, is generated); 
and 

(c) receiving the image signal and the decision signal (i.e. the large block in figure 1 
receives both), and outputting a foreground signal and a background signal, via a 
foreground/background separation module, a representation of the current pixel of the image 
signal being included in at least one of the foreground signal and the background signal in 
accordance with the decision signal (i.e. a pixel is indicated as being included in either the 
background image or the foreground image based on the binary mask ("decision signal") 
outputted from the "Text Detection (Segmenting)" block). 

However, Barthel does not appear to disclose "sub-sampling the image by a 
programmable amount" and then receiving the sub-sampled image for outputting a foreground 
and a background signal. As shown in figure 1, it appears that BarthePs Determination of the 
Background/Foreground block receives the inputted document image at the original resolution 
and does not sub-sample the image prior to receiving it. 

Zhu discloses a method (figure 1) for identifying text apart from background in an image 
in order to process the text for recognition purposes and the like. In particular, Zhu teaches that, 
prior to segmenting the foreground text from the background (108), it is advantageous to sub- 
sample the image (103). The sub-sampling step is preferred because, according to Zhu, the 
reduction in resolution has the effect of reducing processing demands. However, the sub-sampled 



f 
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image will still exhibit sufficient detail to permit effective text/background segmentation. See 
column 3/3-8. In view of this teaching that an input image to be subjected to 
foreground/background separation can be sub-sampled in order to reduce the computational 
intensiveness, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Barthel by Zhu to achieve the claimed invention by sub-sampling the 
inputted document image. 

Further regarding claim 10, since Barthel's disclosure is written in terms of a computer- 
implemented method, it does not expressly disclose the system comprising means for performing 
the above steps, per se. However, at the time the invention was made, those skilled in the art 
would have readily understood that Barthel's method was intended to be performed via a 
computer, thereby necessitating the employment of physical components to perform the method, 
e.g. processors or the like performing programmed methods/modules. That is to say that the 
claimed system for separating an image signal are rendered obvious in view of Barthel's 
corresponding method for the same — Official Notice taken. 



Regarding claims 2 and 1 1, Barthel discloses operation (c) further comprises: 
receiving the foreground signal (figure 4) and the background signal (figure 5); 
filling undefined pixels in the foreground and background signals with values computed 
so as to substantially prevent artifacts and to facilitate good compression ratio, using a cleanup 
module (figures 4 and 5: "Filling the remaining regions"; see also column 5, lines 10-15 and 43- 



47); and 



outputting a final foreground signal and a final background signal (see figure 1). 
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Regarding claim 3 and 12, Barthel discloses the operation of filling comprises: 

extending content of defined pixels in each of the foreground and background signals to 
neighboring undefined pixels by filling neighboring undefined pixels with diluted foreground 
and background values, respectively, using a dilate module (figures 4 and 5: "spreading"); 

averaging non-zero content of the diluted foreground and background values over 
minimum coded unit blocks and outputting averaged block values, using a block average module 
(column 5, lines 10-15 and 43-47: the average value of all values not equal to zero is calculated 
and used for filling); and 

filling any remaining undefined pixels with the averaged block values, using a fill module 
(figures 4 and 5: "Filling the remaining regions"). 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Colin M. LaRose whose telephone number is (571) 272-7423. If 
attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
Bhavesh Mehta, can be reached on (571) 272-7453. The fax phone number for the organization 
where this application or proceeding is assigned is (571) 273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
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system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. Any inquiry 
of a general nature or relating to the status of this application or proceeding can also be directed 
to the TC 2600 Customer Service Office whose telephone number is (571) 272-2600. 



Colin M. LaRose 
Group Art Unit 2624 
28 March 2007 




